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Abstract 

A mathematical model for behavioral chan- 
ges by pair interactions (i.e. due to direct 
contact) of individuals is developed. Three 
kinds of pair interactions can be distin- 
guished: Imitative processes, avoidance pro- 
cesses, and compromising processes. Repre- 
sentative solutions of the model for two dif- 
ferent interacting subpopulations are illus- 
trated by computational results. 

The equations of game theory are shown to 
result for a special case of imitative pro- 
cesses. Moreover, a stochastic version of 
game theory is formulated. It allows the 
derivation of equations for the most proba- 
ble or the expected distribution of behavioral 
strategies and of (co)variance equations. The 
knowledge of the (co)variances is necessary 
for the calculation of the reliability of game 
theoretical descriptions. 

The use and application of the introduced 
equations is illustrated by concrete exam- 
ples. Especially, computational results for 
the selforganization of social conventions by 
competition of two equivalent strategies are 
presented. 

1 Introduction 

This paper treats a mathematical model for 
the change of the fraction P(i, t) of individu- 
als who show a certain behavior i. Models of 
this kind are of great interest for a quantita- 
tive understanding or prognosis of social de- 
velopments. For the description of the com- 
petition or cooperation of populations there 
already exist game theoretical approaches 
(see, for example, Mueller (1990), Axel- 
rod (1984), von Neumann and Morgen- 
stern (1944), Luce and Raiffa (1957)). 



However, the model devoloped in this paper 
shows to be more general, since it includes 
as special cases 

• not only the game dynamical equations 
(Hofbauer and SlGMUND (1988)), but 
also 

• the logistic equation (Verhulst (1845), 
Pearl (1924), Helbing (1992)), 

• the Gravity model (Ravenstein (1876), 
Zipf (1946)), 

• the Lotka-Volterra equations 

(LOTKA (1920, 1956), VOLTER- 

ra (1931), Hofbauer (1981), Goel et. 
al. (1971), Hallam (1986), Goodwin 
(1967)), and 

• the quantitative social models of Weid- 
lich and Haag (Weidlich & Haag 
(1983, 1988), Weidlich (1991)). 

This model assumes behavioral changes to 
occur with a certain probability per time 
unit, called the transition rate. The transi- 
tion rate is decomposed into 

• a rate describing spontaneous behav- 
ioral changes, and 

• a rate describing behavioral changes due 
to pair interactions of individuals. 

Three different kinds of pair interactions can 
be distinguished: 

• First, imitative processes, which de- 
scribe the tendency to take over the be- 
havior of another individual. 

• Second, avoidance processes, causing an 
individual to change the behavior if 
meeting another individual with the 
same behavior. 



• Third, compromising processes, which 
describe the readiness to change the be- 
havior to a new one when meeting an 
individual with another behavior. 

Representative solutions of the model are il- 
lustrated by computer simulations. By dis- 
tinguishing several subpopulations a, differ- 
ent types of behavior can be taken into ac- 
count. 

As one would expect, there is a connection 
of this model with the game dynamical equa- 
tions. In order to establish this connection, 
the transition rates have to be taken in a 
special way which depends on the expected 
success of the behavioral strategies. The es- 
sential effect is given by imitative processes. 

A stochastic formulation of the game dy- 
namic equations shows that the ordinary 
game dynamical equations result as equa- 
tions for the most probable behavioral distri- 
bution or as approximate mean value equa- 
tions. 

For the approximate mean values corrections 
can be calculated. These corrections depend 
on the (co)variances a%j of the numbers m of 
individuals who show a certain behavior i. 
The calculation of the (co)variances is also 
useful to determine the reliability of game 
theoretical descriptions. 

An example of two equivalent competing 
strategies serves as an illustration of the 
game dynamical equations and their stochas- 
tic version. It allows the description of the 
self organization of a behavioral convention. 

2 The master equation 

Suppose, we have a social system with N in- 
dividuals. These individuals can be divided 
into A subpopulations a consisting of N a in- 
dividuals, i.e., 

A 

a=l 

By subpopulations different social groups 
(e.g. blue and white collars) or different char- 
acteristic types of behavior are distinguished. 



The N a individuals of each subpopulation a 
are distributed over several states 

i€{l,...,S}, 

which represent the behavior or the (behav- 
ioral) strategy of an individual. If the occu- 
pation number n" denotes the number of in- 
dividuals of subpopulation a who show the 
behavior i, we have the relation 

E< = iv„. (i) 
i=i 

Let 

n := (n\,...,n$,...,n£) 

be the vector consisting of all occupation 
numbers nf. This vector is called the socio- 
configuration, since it contains all informa- 
tion about the distribution of the N individ- 
uals over the states i. P(n,t) shall denote 
the probability to find the socioconfiguration 
n at time t. This implies 

0<P{n,t)<l and ^P(n,i) = l. 

n 

If transitions from socioconfiguration n to n' 
occur with a probability of P(n', t + At\n, t) 
during a short time interval At, we have a 
(relative) transition rate of 

P(n',t + At\n,t) 

win ,n:t) := hm . 

V ' ' ' At^O At 

The absolute transition rate of changes from 
n to n' is the product w(n' ,n;t)P(n,t) of 
the probability P(n,t) to have the config- 
uration n and the relative transition rate 
w(n',n;t) if having the configuration n. 
Whereas the inflow into n is given as the sum 
over all absolute transition rates of changes 
from an arbitrary configuration n' to n, the 
outflow from n is given as the sum over all 
absolute transition rates of changes from n 
to another configuration n' . Since the tem- 
poral change of the probability P(n, t) is de- 
termined by the inflow into n reduced by the 
outflow from n, we find the master equation 



n a 



— P(n, t) = inflow into n 
at 

— outflow from n 

= J2w{n,n';t)P(n',t) 

n> 

- ]>>(n>;i)P(rM) (2) 

n' 

(see Haken (1983)), which is a stochastic 
equation. 

It shall be assumed that two processes con- 
tribute to a change of the socioconfiguration 
n: 

• Individuals may change their behavior 
i spontaneously and independently of 
each other to another behavior i' with 
an individual transition rate w a (i',i;t). 
These changes correspond to transitions 
of the socioconfiguration from n to 



rt, 



(nl,...,(n?, + l), 

l),...,nj) 



with a configurational transition rate 
win^^n^t) = n t -w a (i',i;t), which is 
proportional to the number nf of indi- 
viduals who can change the behavior i. 

An individual of subpopulation a may 
change the behavior from i to i! dur- 
ing a pair interaction with an individ- 
ual of a subpopulation b who changes 
the behavior from j to j' . Let transi- 
tions of this kind occur with a probabil- 
ity w a b(i' ,j';i,j;t) per time unit. The 
corresponding change of the sociocon- 
figuration from n to 



n i'j'ij 



:= (ni,...,(n?, + l),..., 
x (nf-l),...,(4 + l), 
x ...,(n5-l),...,n|) 



leads to a configurational transition rate 
w(nf jli:j ,n;t) = n%n b j w ab (i' ,j';i,j;t), 
which is proportional to the num- 
ber nfn b of possible pair interac- 
tions between individuals of subpop- 
ulations a resp. b who show the be- 
havior i resp. j. (Exactly speaking — 
in order to exclude self-interactions — 
nfnfw aa (i',j';i,i;t) has to be replaced 



by nf(nf - l)w aa (i' J';i,i;t), if P(n,t) 
is not negligible where n" > 1 does 
not hold, and J2j' w aa {i\ j 1 ; i, i; t) <C 



w a (i',i;t) is invalid.) 



The resulting configurational transition rate 
w(n',n;t) is given by 



w(n', n; t) 
nfw a (i',i;t) 



if n' = nf, ■ 



nfnfaat, (i',j';i,j;t) if n' = nf jHj 
otherwise. 



(3) 



As a consequence, the explicit form of the 
master equation (||) is 

= Y, [«, + i)i,(v';t)p(i.;„i) 

a,i,i' 

- T$Wa(i',i;t)P(n,t) 
+ lH £ [«' + !) (4 + !) 

a,i,V b,j,j' 

xw ab (i, j; i',f; t)P{nf jHj ,t) 



- nin b j w ab {i',j';i,j;t)P(n,t) 
(see Helbing (1992a)). 



3 Most probable and expected behavioral 
distribution 

Because of the great number of possible so- 
cioconfigurations n, the master equation for 
the determination of the configurational dis- 
tribution P(n,t) is usually difficult to solve 
(even with a computer). However, 

• in cases of the description of single or 
rare social processes the most probable 
behavioral distribution 



P a (i,t) :-- 



nf(t) 



N n 



is the quantity of interest, whereas 



7 70 



in cases of frequently occuring social 
processes the interesting quantity is the 
expected behavioral distribution 



P a (i,t) :-- 



Equations for the most probable occupa- 
tion numbers nf(t) can be deduced from a 
Langevin equation for the development of 
the socioconfiguration n(t). For the mean 
values {nf)t of the occupation numbers nf 
only approximate closed equations can be 
derived. A measure for the reliability (or 
representativity) of n"(t) and (nf) t with re- 
spect to the possible temporal developments 
of nf(t) are the (co)variances o~fht) of nf(t). 



3.1 Mean value and (co)variance 
equations 

The mean value of a function f(n,t) is de- 
fined by 

</(n, t)) t = (f(n, t)) := £ f(n, t)P(n, t) . 

n 

It can be shown that the mean values of the 
occupation numbers f(n, t) = nf are deter- 
mined by the equations 



d(nf) 
dt 



«(«,*)> 



(4) 



with the drift coefficients 

m?(n,t) := - n?)w(n', n; t) 

n' 

-IZJ a (i',i;tK] (5) 
and the effective transition rates 
w a (i',i;t) := w a (i',i;t) 

+ EEE^^'J'^'^i ( 6 ) 

b j' j 

(see Helbing (1992a)). Obviously, the con- 
tributions w a b(i' ,j';i,j;t)n b due to pair in- 
teractions are proportional to the number n b 
of possible interaction partners. 



3.1.1 Approximate mean value and 
(co)variance equations 



Equations (|j) are no closed equations, since 
they depend on the mean values (nfn b ), 
which are not determined by (|j). However, if 
the configurational distribution P(n, t) has 
only small (co) variances 



a 



lib 
ij 



("?-<«?»(»S -<"}») 
Kn b j )-K)(n b 1 ), (7) 



we find in first order TAYLOR approximation 
the approximate mean value equations 



dt 



« (<«n),t) 
= <((n),t). 



(8) 



In many cases, the initial configuration no 
at time to is known by a measurement, i.e., 
the initial distribution is 



P(n,t )=S. 



nno > 



where the Kronecker function 5 xy is de- 



fined by 



■>xy •- 



1 if x = y 
if x ^ y . 



As a consequence, the (co)variances af b van- 
ish at time to and remain small during a cer- 
tain time interval. For the temporal develop- 
ment of afj, the equations 



da: 



dt 



m$(n,t) 



+ («-«))m;(n,t); 
+ ((n b - (n b ))mUn,t)) (9) 

can be found. Here, 
rti(n,t) 



n> 



(n't-nl)(n' b -n b )w(n',n;t) 



ion 



+ n?xD a O',*;t) 
ni,vf(i,i';t) 



j' 3 

+ n"n-,w a6 (j, j';i,i';t) 



+ n°;n b i ,w ab (i,j';j,i';t) 



(10) 



are diffusion coefficients (see Helbing 
(1992a)). Equations (|) are, again, no closed 
equations. However, a first order Taylor 
approximation of the coefficients m"(n,t) 
leads to the equations 



dt 



m#«n>,t) 



cfc V 



ac 0m5((n),t) 



<9(re£ 



bc dmf({n),t) 



d{n%) 



(11) 



(see Helbing (1992a)), which are solv- 
able together with (Q). The approximate 
(co)variance equations ( |IT| ) allow the deter- 
mination of the time interval during which 
the approximate mean value equations (||) 
are valid (see figures ^ and 3b). They are 
also useful for the calculation of the reliabil- 
ity (or representativity) of descriptions made 
by®. 

3.1.2 Corrected mean value and 
(co)variance equations 

Equations (||) and (|ll|) are only valid for the 
««)<n»>, (12) 



case 



a 



ab 



where the absolute values of the (^varian- 
ces of- are small, i.e., where the configura- 
tional distribution P(n, t) is sharply peaked. 



For increasing (co)variances, a better ap- 
proximation of @, @ should be taken. A 
second order Taylor approximation results 
in the corrected mean value equations 

d(n?) 



dt 



+ 



1 Wfffcc d 2 mf((n),t) 



- b,j c,* OtyW'k 
and the corrected (co)variance equations 



(13) 



doff 
dt 



m 



((n),t) 



+ 



+ 



o X! X! a M 



c,k d,l 



d 2 m?°{(n),t) 
d(n c k )d(nf) 



dm){{n),t) 
d(n%) 



bc dmf((n),t) 




d(n c h 



(14) 



Note, that the corrected mean value equa- 
tions explicitly depend on the (co)variances 
afj, i.e., on the fluctuations due to the 
stochasticity of the processes described! 
They cannot be solved without solving the 
(co)variance equations. However, the calcu- 
lation of the (co)variances is always recom- 
mendable, since they are a measure for the 
reliability (or representativity) of the mean 
value equations. 

A comparison of exact, approximate and cor- 
rected mean value and variance equations is 
given in figures [l] to [|. A citerium for the va- 
lidity of (§) and (0) resp. (0) and (0) are 

the relative central moments 



C m (ii, 



«-«>)•■■■• wr-(<r>) 



Whereas the approximate equations (N) , ( 11 ) 
already fail, if 

\C m \ < 0-04 (15) 

is violated for m = 2 (compare to ([i~2|), ([?])), 
the corrected equations (|i~3|), ( |i~4| ) only pre- 
suppose (|l~5| ) for 2 < m < I with a cer- 
tain value I (see Helbing (1992a)). How- 
ever, even the corrected equations (|l3|), (14) 
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become useless, if the probability distribu- 
tion P(n, t) becomes multimodal. 

Figures || to || show computational results 



corresponding to the example of section 5.2 



Exact mean values (m) and variances an are 
represented by solid lines, whereas approxi- 
mate results according to (||), (|Tl|) are rep- 
resented by dotted lines, and corrected re- 
sults according to (|l3|), by broken lines. 
As expected, the corrected mean value equa- 
tions yield better results than the approxi- 
mate mean value equations. 




Figure 1: Exact ( — ), approximate (■ • •) and cor- 
rected ( ) mean values (upper curves) and vari- 
ances (lower curves) for a small configurational dis- 
tribution P(n,t): Both, approximate and corrected 
equations are applicable. 




Figure 2: As figure [l], but for a broad configurational 
distribution: The corrected equations still yield use- 
ful results, whereas the approximate equations al- 
ready fail, since the variances are not negligible. 




Figure 3a: As figure [l], but for a multimodal config- 
urational distribution: Not only the approximate but 
also the corrected equations fail after a certain time 
interval. However, whereas the approximate mean 
value and variance become unreliable already for 
t > 1, the corrected mean value and variance remain 
valid until t > 3. 




Figure 3b: The relative central moments are a cri- 
terium for the validity of the approximate resp. the 
corrected mean value and (co)variance equations: If 
| C2 1 ( — ) exceeds the value 0.04, the approximate 
equations fail, whereas the corrected equations fail, 
if \C 3 \ (- -) or [C 4 | (■ • ■) exceed the value 0.04. 



3.2 Equations for the most probable 
behavioral distribution 

The master equation (||) can be reformulated 
in terms of a Langevin equation (see Hel- 
BING (1992)): 



n,t) + fluctuations . (16) 



^ a,,\ JV>1 a 



The Langevin equation (|16|) describes the 
behavior of the socioconfiguration n{t) in de- 
pendence of process immanent fluctuations 
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(that are determined by the diffusion coeffi- 
cients mfj). As a consequence, 

±nt{t) N = l rnt{n,t) (17) 

are the equations for the most probable oc- 
cupation numbers nf(t). The equations ( |l7| ) 
look exactly like the approximate mean value 
equations (|8|). Therefore, if N 3> 1, the ap- 
proximate mean value equations (§) have an 
interpretation even for great variances, since 
they also describe the most probable behav- 
ioral distribution. 

4 Kinds of pair interactions 



The pair interactions 



i',f 



i, J 



of two individuals of subpopulations a resp. 
b who change their behavior from i resp. j 
to i! resp. j' can be completely classified ac- 
cording to the following scheme: 




hJ 
i',3 



3,3 
i . i 



if + i) 
(i' + 3) 



h3 

i',3 

i',f 



i,3 (i ¥= 3,f + 3,f i) 

i,3 (i 3,i' ¥=i,3' 3, 
i' + 3,f + i) 



(3) 



3,i < — h3 (i^j) 

< — i,j (i^j,i'^i,i'^j) \(4) 

3, f < — h 3 (i + 3, f + 3, f + i) 

Obviously, the interpretation of the above 
kinds k G {0,1,..., 4} of pair interactions 
is the following: 

(0) During interactions of kind (0) both in- 
dividuals do not change their behavior. 
These interactions can be omitted in the 
following, since they have no contribu- 
tion to the change of P(n,t) or nf(t). 



(1) The interactions (1) describe imitative 
processes (processes of persuasion), i.e., 
the tendency to take over the behavior 
of another individual. 

(2) The interactions (2) describe avoidance 
processes, where an individual changes 
the behavior when meeting another in- 
dividual showing the same behavior. 
Processes of this kind are known as aver- 
sive behavior, defiant behavior or snob 
effect. 

(3) The interactions (3) represent some 
kind of compromising processes, where 
an individual changes the behavior to 
a new one (the "compromise") when 
meeting an individual with another be- 
havior. Such processes are found, if a 
certain behavior cannot be maintained 
when confronted with another behavior. 

(4) The interactions (4) describe imita- 
tive processes, in which an individual 
changes the behavior despite of the fact, 
that he or she convinces the interaction 
partner of his resp. her behavior. Pro- 
cesses of this kind are very improbable 
and shall be excluded in the following 
discussion. 

For the transition rates corresponding to 
these kinds of interaction processes the fol- 
lowing plausible form shall be assumed (see 
Helbing (1992)): 

w a b{i',j';i,j;t) := v ab (t) 



x < 



if i' = j and j' = j 
if j' = i and i! = i 
if i' = j and f / j 
if j' = i and i' ^ i 



Here, 



pLU'\r,t) 
o 
o 

P k ab (i'\i;t) 

xPbati'ti; t) otherwise {k G {2, 3}). 

(18) 

v ah (t) := N h v ah (t) 



is the contact rate between an individual of 
subpopulation a with individuals of subpop- 
ulation b. PabUH'^) is the probability of an 
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individual of subpopulation a to change the 
behavior from i to j during a pair interaction 
of kind k with an individual of subpopulation 
b, i.e., 

j 

Let us assume 

PabiMt) :=f* b (t)Ra(j,r,t), 

where ft b (t) is a measure for the frequency of 
pair interactions of kind k between individ- 
uals of subpopulation a and b, and R a (j, i) t) 
is a measure for the readiness of individuals 
belonging to subpopulation a to change the 
behavior from i to j during a pair interac- 
tion. Inserting the rate (|i~8| ) of pair interac- 
tions into (||) and using the conventions 



w a (i',i;t) 

Wab{i',j';i,j;t) 

P a (i,t) 



w a (i',v,t) , 
NbW a b(i',j';i,j;t) 

Vab{t)f k ab (t) , 



N a 



(19) 



we arrive at the approximate mean value 
equations 

d 



v 

-w a (i',i;t)P a (i,t)] (20) 
(see (||), (|5|)) with the mean transition rates 
w a (i,i';t) + R a (i,i';t) 

E[(^)-^(*))nM 
b 

+ (v 2 ab (t)-v 3 ab (t))p b (i',t) 



w a (i,i';t) 



+ "ab(t) 



(21) 



(if iV a > 1; see Helbing (1992, 1992b)). The 
mean transition rates include contributions 
of spontaneous behavioral changes, and of 
behavioral changes due to pair interactions 
(i.e., of imitative, avoidance and compromis- 
ing processes). (^0|) , (|2~l"l) are Boltzmann- 
like equations (see Boltzmann (1964), Hel- 
bing (1992a)). 



Due to dD, (H), and < nf < N a we have 
the relations 

Y / Pa(i,t) = l and 0<P a (i,t)<l. 



Therefore, P a (i,t) can be interpreted as the 
fraction of individuals within subpopulation 
a who show the behavior i. With respect to 
the total population, the fraction P(i, t) of 
individuals with behavior i is given by 



p(i,t) 



N 

N Na 2^ Kr^aKh 1 ) 



N 



N 



4-1 Computer simulations 

For an illustration of the BOLTZMANN-like 
equations (p0[), (p|) we shall assume to have 
two subpopulations (A = 2), and three dif- 
ferent behaviors (5 = 3). With 



Ra(i',i;t) :- 



3 Ua(i',t)-U a (i,t) 

D a (i',i;t) ' 



(22) 



(see Weidlich and Haag (1988), Helbing 
(1992)) the readiness R a {i' ,i;t) for an indi- 
vidual of subpopulation a to change the be- 
havior from i to i' will be the greater, the 
greater the difference of the utilities U a (.,t) 
of behaviors i' and i is, and the smaller the 
incompatibility ("distance") 

D a (i',i;t) = D a (i,i';t) >0 

between the behaviors i and i' is. 

In the following computer simulations 
D a (i', i; t) = 1 has been taken. For both sub- 
populations the prefered behavior, i.e., the 
behavior with the greatest utility U a (i,t) is 
represented by a solid line, whereas the be- 
havior with the lowest utility is represented 
by a dotted line, and the behavior with 
medium utility by a broken line. Figures 4a 
to ^3b| show the effects of imitative processes 

= 1, = = of avoid - 

ance processes {^ b (t) = 1, ^(t) = = 

v^ b {t)), resp. of compromising and imitative 

processes (i&(t) = 1 = i/^(t), = 0) 
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a) for equal behavioral preferenes (J7i(l) = 
c = U 2 (l), C/i(2) = = U 2 (2), Ux(3) = 
—c = U2(3)), and 



b) for different behavioral preferences 
(U^l) = c = U 2 (2), 17! (2) = = U 2 (l), 
U 1 (3) = -c = U 2 (3)). 



In more complicated cases, there are also os- 
cillatory or chaotic behavioral changes possi- 
ble, as illustrated in figures (see Helbing 
(1992b, 1992)) and| (see Helbing (1992)). 




a. 00 I , , — 1 

0.00 0.50 LOG 1.50 2.0D 

t 

Figure 4a: Effect of imitative processes for two sub- 
populations prefering the same behavior (c = 0.5): 
Only the fraction of the prefered behavior ( — ) is in- 
creasing. The other behaviors vanish in the course of 
time. 




o.oo J ■ . . . . 1 

0.00 1.00 2.00 3.00 4.00 5.00 6.00 

t 

Figure 4b: Effect of imitative processes for two sub- 
populations prefering different behaviors (c = 0.5): 
The prefered behavior ( — ) becomes the predomi- 
nating one in each subpopulation, but the behavior 

which is prefered in the other subpopulation ( ) 

can also convince a certain fraction of individuals. A 
behavior which is not prefered by any subpopulation 
(■ ■ ■) vanishes. 



: . co 



0.75 



0.50 




0. 25 



0. 00 J ■ ■ ■ 

0.00 0.50 1.00 1.50 2.00 

t 

Figure 5a: Effect of avoidance processes for two sub- 
populations prefering the same behavior (c = 1): The 
fraction of the prefered behavior ( — ) is limited, since 
the subpopulations avoid to show the same behavior. 
As a consequence, the other behaviors are also used 
by a certain fraction of individuals. 



1.00 



0.75 



0.25 



0.00 




0.00 0.50 1.00 1.50 2.00 

t 

Figure 5b: Effect of avoidance processes for two 
subpopulations prefering different behaviors (c = 1) : 
The fraction of the prefered behavior ( — ) wins a 
greater majority in comparison with figure Bal since 
the situations of avoidance are reduced. 



1.00 



0.75 



0.25 



O.UU 




0.00 0.50 1.00 1.50 2.00 

t 

Figure 6a: Effect of compromising and imitative 
processes for two subpopulations prefering the same 
behavior (c = 0.5): Only the prefered behavior ( — ) 
survives, since a readiness for compromises is not 
necessary. 
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0.00 J ■ ■ . ■ . 1 

0.00 1.00 2.00 3.00 14.00 5.00 6.00 

t 

Figure 6b: Effect of compromising and imitative 
processes for two subpopulations prefering different 
behaviors (c = 0.5): Most of the individuals show 
the prefered behavior ( — ), but a certain fraction of 
individuals also decides for a compromise (•••)• 




1.00 J . ■ 

0.00 0.50 1.00 1.50 

y,(r) 

Figure 8: Phase portrait of the scaled variables 
yi(r) :— ctiP{i,[3t) representing chaotic changes of 
the behavioral fractions P(i,i). 



5 Game dynamical equations 




Figure 7a: Oscillations are one possible effect of 
imitative processes. For S = 5 different behaviors, 
the oscillatory changes look quite irregular without 
a short-term periodicity. 




Figure 7b: Phase portrait of oscillatory changes be- 
tween 5 = 5 behaviors having the shape of a torus: 
A long-term periodicity is indicated by the closeness 
of the curve. 



In game theory, i denotes a (behavioral) 
strategy. Let E a (i,t) be the expected success 
of a strategy i for an individual of subpopu- 
lation a, and 

(E a ) :=Y,E a {i,t)P a (i,t) 

i 

the mean expected success. If the relative in- 
crease 

dP a (i,t)/dt 
P a (i,t) 

of the fraction P a (i,t) is assumed to be pro- 
portional to the difference [E a (i,t) — {E a )] 
between the expected and the mean ex- 
pected success, one obtains the game dynam- 
ical equations 

j t P a (i,t) = v a (t)P a (i,t)[E a (i,t) - {E a ) 

(23) 

That means, the fractions of strategies with 
an expected success that exceeds the average 
{E a ) are growing, whereas the fractions of 
the remaining strategies are falling. For the 
expected success E a (i, t), one often takes the 
form 

E a (i,t) :=J2J2 A -b(hj;t)Pb(j,t), (24) 

b j 

where A a ^(i,j;t) have the meaning of pay- 
offs. We shall assume 

A a b{i,j;t) :=r ab (t)E ab (i,j;t) 
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with 



r a b(t) 



where r a b(t) is the relative contact rate of 
an individual of subpopulation a with indi- 
viduals of subpopulation b, and E a b(i,j; t) is 
the success of strategy i for an individual of 
subpopulation a during an interaction with 
an individual of subpopulation b who uses 
strategy j. Since r a b(t)Pb(j,t) is the relative 
contact rate of an individual of subpopula- 
tion a with individuals of subpopulation b 
who use strategy j, E a (i,t) is the mean (or 
expected) success of strategy i for an individ- 
ual of subpopulation a in interactions with 
other individuals. 



By inserting ( |24[ ) and 

V b,j 

into (|23D, one obtains the explicit form 
d 



dt mt) 

u a (t)P a (i,t) 



J2A ab (i,j;t)P b (j,t) 



££P«(»V)4*(i',i;t)i%(j.<) 
V b,j 

(25) 



of the game dynamical equations. ( |25| ) is a 
continuous formulation of game theory (see 
HOFBAUER and SlGMUND (1988)). Equa- 
tions of this kind are very useful for the in- 
vestigation and understanding of the compe- 
tition or cooperation of individuals (see, e.g., 
Mueller (1990), Hofbauer and Sigmund 
(1988), Schuster et. al. (1981)). 

A slightly generalized form of (p3|), 



[w a (i,i';t)P a (i',t) 

V 

- w a (i',i;t)P a (i,t) 



(26a) 



is also known as selection mutation equa- 
tion (Hofbauer and Sigmund (1988)): 
(|26b| ) can be understood as effect of a 
selection (if E a (i,t) is interpreted as fit- 



ness of strategy i), and (26a) can be un- 
derstood as effect of mutations. Equation 
(|26| ) is a powerful tool in evolutionary bi- 
ology (see Eigen (1971), Fisher (1930), 
Eigen and Schuster (1979), Hofbauer 
and Sigmund (1988), Feistel and Ebeling 
(1989)). In game theory, the mutation term 
could be used for the description of trial and 
error behavior or of accidental variations of 
the strategy. 

5.1 Connection between BOLTZMANN-/ifce 
and game dynamical equations 



One expects that there must be a connec- 
tion between the BOLTZMANN-like equations 
(2C), ( pl| ) and the game dynamical equations 
(26), since they are both quantitative mod- 
els for behavioral changes. A comparison of 
(|20|), ( ^T|) with (p6|) shows, that both models 
can become identical only under the condi- 
tions 



it) 



'ah 



" 2 ab(t) 
"ab(t) 



V a {t)b a b 

o, 

0. 



(27) 



That means, the game dynamical equations 
include spontaneous and imitative behav- 
ioral changes, but they exlude avoidance and 
compromising processes. 

In order to make the analogy between the 
game dynamical and the BOLTZMANN-like 
equations complete the following assump- 
tions have to be made: 

• In interactions with other individuals 
the expected success 

E a (i,t) 

= E^^ E *b(hf,t)Pb(j,t) 



(28) 



u a (t)P a (i,t) E a (i,t)-(E a ) , (26b) 



of a strategy is evaluated. This is possi- 
ble, since an individual is able to deter- 
mine the quantities v a b{t)-, Pb(j,t) and 
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E a b(i,j;t): An individual of subpopula- 
tion a meets individuals of subpopula- 
tion b with a contact rate of v a b{t)- With 
a probability of Pb(j,t), the individuals 
of subpopulation b use the strategy j. 
During interactions with individuals of 
subpopulation b who use the strategy j, 
an individual of subpopulation a has a 
success of E a b(i,j;t) if using the strat- 
egy i. 

In interactions with individuals of the 
same subpopulation an individual tends 
to take over the strategy of another indi- 
vidual, if the expected success would in- 
crease: If an individual who uses a strat- 
egy i meets another individual of the 
same subpopulation who uses a strat- 
egy j, they will compare their expected 
success' E a (i,t) resp. E a (j,t) (by obser- 
vation or exchange of their experiences). 
The individual with strategy i will imi- 
tate the other's strategy j with a proba- 
bility plb(j\i',t) that is growing with the 
expected increase 

AjiE a := E a (j,t) - E a (i,t) 

of success. If a change of strategy would 
imply a decrease of success (AjiE a < 0), 
the individual will not change the strat- 
egy i. Therefore, the readiness for re- 
placing the strategy i by j during an 
interaction within the same subpopula- 
tion can be assumed to be 

R a (j, i; t) := max (E a (J, t)-E a (i, t), Oj , 

(29) 

where max(x, y) is the maximum of the 
two numbers x and y. However, due to 
different criteria for the grade of success, 
the expected success of a strategy i will 
usually be varying with the subpopula- 
tion a (i.e., E a (i,t) ^ Eb(i,t) for a ^ b). 
As a consequence, an imitative behav- 
ior of individuals belonging to different 
subpopulations is not plausible, and we 
shall assume 



flit) 



that means, 



Inserting (|27|), (]2§) and 
BoLTZMANN-like equations (|20 
game dynamical equations (| 
special case, since 




into the 
the 
result clS 8l 



max (E a (i, t) - E a (j, t),0 

max (E a (j, t) - E a (i, t),0 
E a (i,t) - E a (j,t) . 



5.2 Stochastic version of the game 
dynamical equations 

Applying the formalism of section ^, a 
stochastic version of the game dynamical 
equations can easily be formulated. This is 
given by the master equation (0) with the 
configurational transition rates @ and 

Wab{i',j';i,j;t) 
■= N b Wab(i',j';i,j;t) 

■= Va(t)5abR a (h j;t)5ii'5ij>(l - 6ij) 

+ Va(t)5 ab R a (j,i;t)5 jj >5 ji >(l - 5ij) , 
where 

R a (j,i;t) := max. (E a (j,t) - E a (i,t),0j 
and 

(compare to Feistel and Ebeling (1989), 
Ebeling and Feistel (1982), Ebeling et. 
al. (1990)). A comparison with (§), @, 
(|2l| ) shows, that the ordinary game dynami- 
cal equations (26) are the approximate mean 
value equations of this special master equa- 
tion. Therefore, they can only be interpreted 
as mean value equations as long as the 
(co) variances afj are small (see (|l2|)). Oth- 
erwise they describe the most probable be- 



havioral distribution (see sect. 3.2 ) 



v lb{t) = Vaa(t)Sab ■ 



5.3 Self organization of behavioral 
conventions by competition between 
equivalent strategies 

This section gives an illustration of the meth- 
ods and results derived in sections || and ^2 
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As an example, we shall consider a case with 
one subpopulation only (A = 1), and, there- 
fore, omit the index a in the following. Let 
us suppose the individuals to choose between 
two equivalent strategies i £ {1,2}, i.e., the 
payoff matrix A(t) shall be symmetrical: 



A(t) = (A(i,j;t 
According to the relation 



A + B B 
B A + B 



(30) 



N 



n\ + n 2 

(see (@)), the fraction P(2,t) = 1 - P(l,t) 
is already determined by P(l,t). By scaling 
the time, 

u(t) = 1 

can be presupposed. For the spontaneous 
change of strategies due to trial and error 
we shall assume the transition rates 



w(j,i;t) :=W . 



(31) 



A situation of the above kind is the avoid- 
ance behavior of pedestrians (see Helbing 
(1991)): In pedestrian crowds with two oppo- 
site directions of movement, the pedestrians 
have sometimes to avoid each other in or- 
der to exclude a collision. For an avoidance 
maneuver to be successful, both pedestrians 
concerned have to pass the respective other 
pedestrian either on the right hand side or on 
the left hand side. Otherwise, both pedestri- 
ans have to stop (see figure ^). Therefore, 
both strategies (to pass pedestrians on the 
right hand side or to pass them on the left 
hand side) are equivalent, but the success of 
a strategy grows with the number of in- 
dividuals who use the same strategy. In the 
payoff matrix ([}(]) we have A > 0, then. 

The game dynamical equations ( p6|) corre- 
sponding to (pC|), ( |3TD have the explicit form 



P{i,t)~\ 



W + AP{i,t)(p{i,t) - 1 



(32) 

According to (|32]), P(i) = 1/2 is a stationary 
solution. This solution is stable only for 



1 



^r <0 ' 




P(2 



P(l 



Figure 9: For pedestrians with an opposite direction 
of motion it is advantageous, if both prefer either the 
right hand side or the left hand side when trying to 
pass each other. Otherwise, they would have to stop 
in order to avoid a collision. The probability P(l) for 
choosing the right hand side is usually greater than 
the probability P(2) = 1 — P(l) for choosing the left 
hand side. 



i.e., if spontaneous strategy changes due to 
trial and error (the "mutations") are dom- 
inating. For k > the stationary solution 
P(i) = 1/2 is unstable, and the game dy- 



namical equations (32) can be rewritten in 
the form 



-2(P(M>4) 

1 + v 7 ^ 




That means, for k > we have two addi- 
tional stationary solutions P{i) = (1+v / k)/2 
and P(i) = (1 — y / /t)/2, which are stable. 
Depending on the random initial condition 
P(i, to), one strategy will win a majority of 
percent. This majority is the greater, 
the smaller the rate W of spontaneous strat- 
egy changes is. 

At the critical point k = kq := there ap- 
pears a phase transition. This can be seen 
best in figures |l0| to [l^, where the distribu- 
tion P(n, t) = P(ni,ri2]t) = P{n\,N—ni;t) 
loses its unimodal form for k > 0. As a con- 
sequence of the phase transition, one strat- 
egy is prefered, i.e. a behavioral convention 
develops. 
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Figure 10: Probability distribution P(n,t) = 
P ( ni , N — ni ; t ) of the socioconfiguration 
n — (m,N — ni) for two equivalent competing strat- 
egies. Mutation dominated region (re < 0): Since 
P(ni,N — ni;i) has, after a certain time interval, 
one maximimum at m — N/2, each strategy will 
most probably be used by about one half of the in- 
dividuals. 



Figure 12: As figure [ltj but after the phase tran- 
sition (re > 0): The configurational distribution 
P(m,N — nv,t) becomes multimodal with maxima 
that are symmetrical with respect to N/2, because of 
the equivalence of the strategies. Due to the maxima 
at m > N/2 and n 2 = N - m > N/2, one of the 
strategies will very probably win a majority of users. 
This implies the selforganization of a behavioral con- 
vention. 




Figure 11: As figure |lC], but for the critical point 
re = 0: The broadness of the probability distribution 
P(ni,N — m;t) indicates critical fluctuations, i.e., a 
phase transition. 



Figure 13: As figure |ll|, but with a modified ansatz 
for the readiness R a {j,i;t) to change the behavior 
from i to j, which does not produce a crease of 
P(m,N - ni;t) at N/2. 
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The crease of P(ni, N— m; i) at ni = N/2 = 
ri2 is a consequence of the crease of the func- 
tion R a (j,i; t) = m&x(E a (j,t)-E a (i,t),0). It 
can be avoided by using the modified ansatz 

e Ea(j,t)-E a {i,t) 

Ra{j ' i]t) '= DfiM 

(compare to which a ls° shows a phase 

transition for k = (see figure |l3|) . 

6 Summary and Conclusions 

A quite general model for behavioral changes 
has been developed, which takes into account 
spontaneous changes and changes due to pair 
interactions. Three kinds of pair interactions 
have been distinguished: imitative, avoid- 
ance and compromising processes. The game 
dynamical equations result for a special case 
of imitative processes. They can be inter- 
preted as equations for the most probable 
behavioral distribution or as approximate 
mean value equations of a stochastic formu- 
lation of game theory. In order to determine 
the reliability (or representativity) of game 
dynamical descriptions, one has to evaluate 
the corresponding (co)variance equations. 
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